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ABSTRACT , ' . . \ ' ■' ' - 

Based on a review of standardized tests and 
competency assessn^ent ihsttuments^ recommendations are made for 
Identifying and selecting standatdigped tests to help secondary ' . 
vocational instructors to devA^p students' basic skills.' Chapter 1 
focuses on identifyi.ng diagnostic tests of basic skills in reading, 
mathematics, aBd communication. It discusses the concept of sdiagnosis 

^^^eria for selecting tests. Four types of diagnostiq* tests ;are 
oescMbed: i(criterion-ref erenced, norm-referenced, custom-made or 
made-to-order^ 6bjective1s-bas6d item banks-) , aivd* suitably tests" of 
«ach type are named. How diagnostic testing will be presented«in the 
Resource) a<ld, Teacher Guides of the project, Teaching Basic Skills 
Through Vocational Education, is considered., Chapter 2 focuses on 
<^OT^tBtiCY. instruments to assess students' basic .skills. It reviews 
requirements faced' by students for proficiency in basic skills and 
then discusses each set of requirements iti terms of the 'competency 
instruments^ recommended for its assesslntnt . Recommendations are made 
for inclusion of assessment instruments in the Guides. Appendix^es . 
include a list of norta-referenced« tests that were screened out, 
format for test review, list of tests on basic skills that have 
vocationally relevant testing materials built in, and references 
related to readability .analysis. (YLP) 
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;'/ThIs^pap6'r rep^orts the research and findings for. T^sks D and F" of 
this project, Bas^c Skill 'Development Through Vocational Education. 
TasK> D concerns the flection of standardized ^ests -of basic skills f er 
purposes Of .diagnosis. Task^F foauses on assessment* Instruments for 
measuring basic skills related, to occupational competencies. The purpose 
^ Of both, tasks is to identify'proceduries and materials for testing which 
, Will help secondary vocatipnal instiructor^i, to develop the ^)asie skills ofj .* 



their students. 



Standardized tests which are^ recommended for 'use in vocational 



lese recom-^ 



. education, settings are listed and described in Chapter -One. ( tK 
mendations are carried to the point of ^eci^ing .How diapcisti^/^^eskng - 
, will be presented -in the pro|ect »s Resourc'e arid Teacher Gu^es. - 



The sefcond -.chapter focuses'^on competency instruments which will aid 
vocational educators in assessing the. basic skills of their student^.! :T3iis 
chapter begins- with a Brief description of -the reqiriiig^nts faced, by - student 
for proficiency in tqsic skills: "nien each set of requirements is discussed 
in terms of ^theocomp'etency instruments recommended for its' assessment.- 
Finally, recommendations, are made for the inclusion of assessment instru- 
ments in the..,project's Resource, and Teacher Guides. ■ • * . 



This paper' ends with^four appendices. The first two concern ^tan- * 

> ' - ^ ■* ' * ^ 

idardized. tests, (i.e.•^,. those screened, out after review, and /format:s .for . 

^review of- tests). The third appen^Iix lists texts Ajrhich have VociU^iaii^lly . 

relevant testing- materials built in! The fourth appendix lists references' 

related to readability analysis. ' ' o * " ♦ ' ^ 

■■• . . . .■ . • 5 . ■ ■ 

. Thanks ^a,. to C. Wallcer .since an important aspect of the Basic 



Ski^ii bevelo\ienf^Throu|Ji Vocational E\iucatioTn prdject^has been the 
qareful x&view of the standardized test;5^nd competency assessment 



instruments. Thd' results.^of this work^which are' reported in this paper 
foruv a firm basis for* the major project deliverables, the Resource and 
Teacher 'Gxiides\ ' Thanks also go <i:o L. Snyder ^or her competent typing 
of the final draft of this paper. 

James A. . Dunn 
Principal Investigator and 
Director,. Cornell Institute for 
< Occupational Education 
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JTER ONE 
) TESTS (TASK D) 



THfs task consists of identifying diagnostic tests' of basic skills 
.in reading, mathematics, and communication.' Unresolved issues regarding, 
the use of diagnostic tests in vocational progra"^ are discussed and 
Tecommendations for-i:heir- resolution are made. After introducing the 
concfepts-^f diagnostic' testing and basic skills, this paper discusses 
criteria for selecting tests to b^ described in the project '.s Gyides. 
•Then, four types of diagnostic tests are described, and the suitable tests 
of each type are listed by name. Finally; medns of using such tests to 
improve vocational instruction are recommended'. 



. ■ The Concept of Diagnosis 

- Diagnostic testing of basic academic skills involves the use of tests- 
which provide a profile of strengths and needs for each strident. These - 
tests have separate sets of items for each of a fairly large number of 
objectives (i.e. , " 10-40) or -otherwise teachable skills.,*; the' objectives 
being stated in terms ^of reading or mathematics curriculum. By reporting 
a. separate score for each objective,' these -tests enable interpretation in 
terms of what- studehts can and caTinot do. Diagnostic' tests contrast with 
survey tests, which glv^. scores for a f4w broad domainte. of achievement such 
33 reading comprehension or problem solving . * 




A diagnostic tC^t Q.n reading or mathematics is really a battery of 
subtests. Its^ug^ulness for-lnstru.ct?ion comes first from th^- specificity 
v±th which the basic skills are defined. Skills are defined narrowly 
a'Al' explicitly enough' so that' scores for indi^dual objectives can be ^ 
related to specific 'lesSons or instructional kctivities. That' is, dia'g- 
nostla tests support Instructional prescription. As an aid in prescrip- 
tiony a .number of test publishers sell curriculum guides which"^ross- ' -^ 
- ref^^^ to the scope and sequence charts and to 

t>e lessons in major. series of teaqhing. materials. '. l|| 



• A se^cond .property of diagnostic tests which supports instruction is * 

their rapid reporting of scores to teachers. Many of these batteries are 

equipped with templates 'for easy scoring on-site, and the machine ^coring 

by publislWs- is faster than that for conventional survey testing. Thus, 

the resultjs are more available in the optima*l time frame for instructional 

planning. \^ 

ft « 

Cfite/i on-referenced tests (CRTs) an^some norm-rsreferenced tests (NRTs) 
are designed to support diagnosis. The main dif ference^bstween thfese 
two types of -tests is in the 'form of score they emphasize. ^Ircent cor- 

^ rect or proficient/not proficient are the primary types of scores for 
CRTs, whereas comparative mea^ijnses such* as percentile norms, grade-level 
equivalet\ts, quartiles, and st^anines are- commonly reported- for norm-refer- 
enced testSi. The distinction is like the difference between a runner's ^ 
time for running a race and the runner's place of finish. The runner's 
time is an absolute or criterion-referenced ^measure of achievement, while 
the rtttiner's place. is a comparative, or nbrm-referenced measure of achieve?- 
ment. The. absolute or criter;Lon-reference^ measure is a more , direct index 
of what a pupil knows or can do. In this sense, "criterion-referenced 

.tests arq generally mote usefiil in competency-based* programs, 

Criteria for Selecting Diagnostic Tests 

Many widely known tests of basic skills are not useful for diagnosis 

^and prescription. ' Published reviews of most standardized tests have' 

generally been critical of their technical merits j and teachers are gener- 

ally critical of these tests for giving scored that are "too general to be ^ 

diagnostic. Moreover, some tests aire explicitly advertised as diagnostic, 

/ t » ' 

while most are not. In response to^'this s:^tuation a set of criteria for 

screening tests wds established for this project. These criteria ^ shown 

'.in Figure 1, will be listed in- the Resource Guide*' 



. - - Figure;. 1 ; 
CRITERIA FOR SCREENING DIAGNOSTIC TESTS 



ft 



•■ • - . ^ " 

Ready avai lability . Fpr maximum usefulness to vocational 
teachers, tfests need -to be available on call. XHls criteria 
J, excludes secure tests, that- is, tests that, are not readily, 
available to school systems, and fugitive tests such as those . 
that are printed only in^-research journals. 

Appropriateness of gr ade-level coverage .. Qrfly fests coveting 
..levelg of skill that are remedial for high school students will 
be Included. Each of the tests cited in the Resource Guides ' 
cover at least part of this range; fourth throygh eighth grade 
level of skills. . . » ° . 

Adequacy vQf the dev elopment process . Only tests which have 
been reviewed .during their development, field tested, and 
shown to be \i;eliable. will be incj.uded. ** „^ - 

descriptive usefulness. In 'order for tests to support educatiopal 
prescription, they must be tfuly xJiagnpstic of skills and deficits. 
To be, diagnostic, tests must give scores for a variety of explicit' 
and* teachable. objectives and they must have generally more than 
two items per objective. This I'attef requirement reduces error qf ' 
n\easurement,. which has. an^inverse relation to the number of items 
that measure the individual skill. 
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Availability" as a batterv. Tests are sold . in' a variety" of packages 
ranging all the way from" brief survey fqrps to collections of many 
lndivldual,.,test forms. Included _.here!^are tests which can measure 
. jrela.tlvely- ma^y objectives in a -^11 'number of sittings. 

Suitability' for, tes ting groups of students . At least two of the 
otherwise suitable diagnostic tests on the^ market require 6ne-on- 
one testing. Such , tests require a.' high investment of adult time in 
return for' scores on small numbers of. students. They are excluded 
here on grounds of practicality. 



, Two categories of tests discussed below xequire some relaxetioA of^^' 
these criteria: made-to-ordei^ tests and rests of. writing. A ijiade^-to- , 
order test is prepared to measure a unique set ^f objectives-. Field 
testing of eve^-y such test prior to its use would be prohibitively expen- 
siv^, so the requirement for evidence. of reliability must be relaxed here./ 
Nevertheless, an indirect control on quality of these tfests can be exer- 
-cised: - ^by including only those custom-made t^st services whose ready-, 
^made tests in reading and* mathematics show evidence' of reliability. This ^ 
T)ractice is sound, because the publishers use the same 1)asic pools of 
' test items for their ready-made and made-'to-order tests.** 

, . Tests of vritihg raise another issue. Most tests which purport to ' 
» * * * • * 

measure writirfg skills do aot use actual samples of students* writing. 
These .tests are often diagnostic in the sense that one test form will • 

',give scores for seyetal .specif ic skills*, such as punctuation, ,capitaliza- 
tion, usage, sentence structure, spelling, and the like. However, multiple 
choice tests . show only whethet. ^tuden?S can recognize the differences 
between ^better and pporer writing, not whether students can produce pass- 
^ble writing. There^* appear to be. only two carefully deVfeloped tests of* * 
writing samples in fhie right grade range^ jeach- of . whic*h' has a multiple 
choice component as well. These two are^^±fvc3^dl& in the listing' below, 

'even ^though .the validity of the scoring rests iti the hands of the user. 



' Recommended^ Diagnostic Tests. 

Search and Screening. 

To^develop a list oi suitable diagnostic tests,- a s^jarcn arid screening . p 

of existing tests was carried out.. The search* relied mainly on catalogs ^ 
* ' . ' - ' * * /' ' 

of test publishers and the latest books of test reviews as\j50urc§'s.^ These' 
books include Buros* Eighth Mental Measurements' Yearbook , CSEEletn- « ^ 

tary School T6st Evaluations (Hoepfner, 1976)', CSE Secondary School Test * 
Evaluations (Hoepfner, 1974), and the ^CSE Criterion-Refierenced Test Hand- 
book (Walker, 1979). Conversation? with Joan Knapp ofi Educational Testing 



/Service and Ralph Hojepfner, now at Systems Development ' Corporation, 

V. ' ' * , ' 4' - / ^ . • 



supplemented this search. Test materials were either ordered for review "'' 
at Cornell Institute fbr Occupatioiu^l Eduction or screened at the. Cornell 
Guidance and Testing Center. Technical- adequacy of tests was judged by the 
criteria in the S,CE volumes and diagnostic' power was judged by examining 
' each test's fopn for reporting ^miividual pupils' scores.' 



Types and NAnes of Diaghostic Tests 

Sever dl types of diagnostic te^ts met th| screening criteria and. 
warrant recommendation. These include both tests th'at were originally , 
^ designed to support instruction and tests" which have had diagnostic power 
added after the fact through th^ medium of detailed score reports, fiach 
typ&'is .described briefly below, and the examplars. which met the screening 
^criteria "are named. * 

.Criterion-referferieed- tests. The' term criterion-referenced test refers 
. here.tb tests' whose items measure expUcit objectives and .which provide 
^absolute scores for eacK, objective. Items are' selected for these tests 
„ mainly ph.. the 'basis o£ cont^jnt vaUdity, fciiat^is, their congruence with 

the^ test's .Ob jectivbs. The objectivesr^.-^re selected on the basis of expert 
" 'judgment ahd-an anal^is of the instructionar matfTfals. . Around, 60 such 
; . tests of b.asic skills are on the market^ now, 'most of which werfe screened 
out lorJuot^ having aiir evidence of reliability. The following subset of 
•^*^%i°"-"^erenced tests met the sc^^^eening criteria, hence are recommended ! 
Fro^TB McGraw-Hill 

Assessment, of Skills in Computation * • ^ 

. • Diagnostic liathemai:ics Inventory v ; - - 

• Everyday. Skills. Test in Reading and 'Mathematics \ * 
.* * , • Performance Assessment in Reading 
Prescriptive Reading. Inventory 
' Tes.ts of Everyday Writing Skills - - " ^ 

. From Ediicatl^onal Cqkttission of the States I ' * .^^^ -^ ^ 
>• « , ' ' " < * < 

NAEE Released Exercises in Reading aiid Mathematics < _ 



From Educational and Industrial Testing Service 

• Tests of Achievement in Basic Skills (Mathematics) ' \ 

4 > 

.FromNCS Education Systems • ' ^ 

^ \ ♦ Wisconsin Design for .Reading Skill Development: Study Skills 
From Psychological Corporatipn 

••Metropolitan Achievement Tests* 'instructional Tests- 

• Stanford Diagnostic Mathematics Test 
<: • Stanford Diagnostic- Reading Test 




Norm-referenced tests> fform-referenced tests aire typically designed 
to- give^scores on a few broa4 domains, such as reading comprehension ^ in 
terms that tell where- a, student ranks relative to other students, . That 
is^he scores are in t'efms, of rankings rather than degree of proficiency. 
The skills to be tested arp chosen on the 'basis of experts* opinions and 
analyses of instructional materials.. Once test items are wi:itten, they 
are selected on the basis of their statisti%l 'pr^^girties, -Specifically, 
items are chosen to have a mid-range of difficulty at* the target grade 
level and to correlate strongly with iisaividuaib' scores for the' whole set 
Items, This selection process has the intent and result of maximizing 
iLty of measurement'. However, it has the cost of excluding skills 
Vhich are generally well taught and well learned. Thus a great .deal of 
the domain oPbasic skilly is not covereci. 



The main dif ferenlce betwe^erf criterion-referenced and norm-tef erenced 
tests ;Ls. :npj:. in the tests themselves, but in* their scores and interpreta- 
tion. The line between the two types of .test blurs when normative scores 

are provided for each objective of a criteriaa-referenced liest and when 

'''■'^» . * ' »• * . 

raw scores are* provided for small item clusters of a nprm-referenced test. 

Absolute or compete'ncy-based scores are generally more Velevant in voca- 
tional education, but normative, scores can be diagnostic if^ they are for 
specific, teachable skills; ' . • ' ^ 

Three types of -norm-referenced tests of basic skills were reviewed 
. 'fo'r possibly Inclusion: the 'most widely used ones (e,g., Selquential Tests 



of ^Educational progress Battery), tests recommended for our review by 
•other professionals (e.g.',. Test of Adult Basic Education), and tests whosq 
■ titles suggested that _tliey are relevant (e.g.. Diagnostic Tests in Mathe- 
^ matics). The foaiowing tests are recommended since they met th6 screening 
.criteria: • • * ^. • * , 

From CTB McGraw-Hill , - ' . ■ 

• California Achievem^t ' Test • a ' 

^ , • ; Comprehensive "Test of Basi-c Skills 

• Test of Adult -Basic EduQation' ^ ; 

From Educational Testing ^Service ' . 

• • ETS Basic Skills Assessment ' # - ' 

From Psychological Corporation 



• Metropolitan Achievement Tests; 

• Stanford Achievement Tests 

• Test of Academic Skills . ^ 

From Science Re^i^arch Associates 

• BRA Achievement Test Se^ 



Survey Battery 



A listing of tes ts* screened ,out of 'the category of acceptable norm^' 
referenced tests* is 'given in Appendix A. The list of "acceptable ones is 
short because few of the publishers make^ triKLy diagnostic scores' available. 
Only a small number of publishers bridge the gap between 'Broad comparative 
scores and instructionally useful scores. They have done this by dividing 
the total set of test items ^into a fairly large number 6f homogeneous 
'Clusters, then providing separate scores for each' of these clusters. 
These subscores relate- more direcfly to instructional felann^ng than do total 
test scores, because they more closely correspond with lessons 9r instruc- . 
tional activities. 



Custom-made or made-t o-order tests . A number of commercial publishers 
will custom-maTce tests in response to special orders 5rom test users. 
f.M'' lusher, ^)rovides a list of objectives for which.it has. test items 



lu stock, arid the user chooses from this list the objectives for ±tq 
©ade-to-.order test. ' . * 



The unique .advantage of this tjhe of resource is its ability 

to match almost any curriculum with- a« wholly -relevant ,test. In contrast, 
' . * • # 

ready-made tests are designed to fit many curricula in a general way, 

but no single curriculum very well. Not only could a customizing service 

creafe a test tp fit a conventional xrtirriculum in reading or mathematics, 

but also it. could create' ^ test of ba^ic skills •for any particular occupa- 

tion. 



There are two disadvantages. 1 6 th^se services. First, 'the lead-time 
• for acquiring custom-made tests is fairly long: six to eight V^eks from 
receipt of the order. Second, the cost is much higher than that for 
ready-made tests, due mainly to the ^requirement for a sizeable minimum" 
order. ^ . • . 

One readily ayailable solution to those 'problems is to purchase a 
non-comiherciaX item bank for the puijpose of custom-making tests on-site. 
Item banks are discussed shortly below. Two other possible remedies would 

^iMquire a greater degree of administrative leadership ♦ For one, a con^ 
-'^loi^tium of test users could be<»formeii among users who Have a common nded. 

. They could achii^e econon^Les .of scal^^ in bujring custom-made tests and then 
'Stock the tests ' at memiier schools for ready use. ..The second remedy would 
Involve persuading a commercial publisher that there is a market for ney, 
vocationally relevant tests -of basic skills. The publisher could make 
up such tests frpm its customizing s'ervice and carry them as. regular . 
catalog s.ale items (i.e*,, ready-made).'-. ' /, 

'Of the six commercial customizing seirvices that were found, three C 
belong tb: publishers whps^^^ parallel Veadjr^-made tests are w^ll field ^ 



.V /• '':\.if^t^diy -These' three 'arez^ v.;. ^ . 

; Mastety Custom Jests v . ^ 

^^WB?^ - * ^ / ' - t>y Science Research Asspciates, 



j - by Science Research Asspciates, 
i. / ^- ^/ ^ 
• ORBIT - v- : 
^ ./By CTB McGraw-HliVand' 



.a 



IS 




• SCQRR C^dterion-^Referenced Tests 
by Houghton-Mifflin • 



Objectives-based Item banks. An item bank is a large collection of 
test items that can be. selectively combiW into tests as the 'user wants. 
Since the items kre jgrouped according to the objectives they measure, the 
banlcs ^re called objectives-based. Three of .these ban^s are for sale to 
districts^ and schools, • thus\they are a resource for custom-making tests 
on--site. Those^three banks , -which meet the screeni;ig criteria, are the^ 
' follqiging. . * ' ' ' 

• Item Banks Package ' , ^ 

by Northwest Evaluation Association • / 

• lER Criterion-Referenced Objective and Item .B^ulk 
^ ^ by Institute for Educational Research . 

• Resource Items for Minimal Competency Testing 
. ^ by Education Co^ission^ of the States 

these banks coyer a wide range of objectives and grades-ip reading 
and mathemati'cs. Ttte first two,Vhich were deVefoped by consortik of. 
school districts, have been Rasch scaled. Thus, .the tests they yield giv4 
scores in teriiisdf^Jjoth instructional obj^ and.JLevel of fuiictibning. 



. w , A Format for/ Test Reviews 

The, Resource Guide will list and review dia^ostic tests'. Several 
different formats a:i:e, Available for the test reviews including prose, 
numerical ratings of the' characteristics of tests, qualitative ratings, 
^^•!^v and^ a, mixture of thesev The'most influential reviewer of tests. Euros 

-(1978) has a mixturg" of descriptive information (e.g. , .prices, levels, date 
. , P^-Publicatidn, •'publisher) in .rather 'abbreviated, standard form alo'ng wit? 

cri-tical-ess^ays. Different t^sts are reviewed by different authors in 
' i. 1"^^; '". content ^of the essays varying considerably from .author to 
■; ;-autjipr, .In-^contrast; the CSE. reviews, of norm-referefaced tests (Hoepfner\ 

given in uniform two-dimensional matrices 'of numbers; 
' • :^J«ttB-ers,; wiiich dedand. a" great deal of interpretation, are fltings- of . 

v#^;fl.?^-flity Pf'^ of "test features. *A third format combines 
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qualitative rating of test features with description of a standaifd set * 
of features' such as levels, prices, scoring options, and, the like. 

In this project diagnostic tests have' already been evaluated, in ^ 
effect, during the screening. Thus, an evaluation component is not needed' 
in the Resource Guides. It is vexf desirable for the reviews to present 
information in a standard, readily accessible form so that readers can 
find what they need to know and can compare* tests. The form should be ^ - 
easy to iise and relevant to the user's needs. . % * 

Two types ofusrersare envisioned for the test reviews: a consumer 
of test results and a person who is involved in selecting tests. For the 
.former, a diagnostic score report, and guidelines for, interpreting it will ' 
be n^^ded. It is likely that some guidelines -for interpretation will apply 
to all^ tests and somejjill be ^test-specific. The former 'may go in a 
Teacher Guide. For the test selector, a thorough ^descript ion of each, test 
'Will be useful in addition to the sample score report.. A recommended . 
model of one such test review is given in Appendix B. . • - * 



Recommendations For the Resource and Teacher^''Giu>des 

* * * ^ ' ^1 

Both the Resource sttid the leacher Guides will be writ/ten on the thesis 

^ that Vocational teacher are consumers of test results, but aire not gen- 

' . . ^ ' . y ^ ' ' 

erally test administrators or main resource persons in reading and mathe- 

maticsf* ^.^ghe.^feather Guide will te^^^desipied ^o support, among other things, 

diagnosis in ongoing "YPcational"^ while the Resoinrce Guide xd.ll 

nave information . that will support test selection and the planning of a 

testing program. Audiences for the Resource Guide would include curriculum, 

counseling; and •testing specialists. 

t ^ A basic issue ija the discussion ^of •testing is whether vocational e^v^ 
\ cation is to be' the means for inrprovlng basic skills or instruction in, basic 
-c.:^fctjl^^ the means for improving students^ iperformance in their "^^^ 



vocational programs. Tl[iis issue bear^' not only on the aims. of the 
projfect, but also on- whether the fociis of " diagnostic testing will be 
basie^ skills In general or entry-level "basic skills for specific jobs (or 
sets of iohs)_. Rather than recommend a choice,. we will 'suggest, a criterion 
for making th^ choi(;e. In 'general terms, the criterion is:., what is most 
likely to make a difference in^ Students' learning. ■ B^cifically, the " ' 
.choice should make sense to vocational educators in .that it should fit 
^their skills, resources,, work load, and aspirations for. their s.tudents. 
'Other^jLse, they are likely to -reject: the diagnosis of basic skills. 

Resource Guide . • * 

The Resource Guide will have sample diagnostic score/report.s, advice 
on interpreting each of the tests listed^ove,' and recommendations for 
making a testing program meet the needs of vocational teachers. The rec- 
ommendations will refer. to selecting tests, timing of testing, and means 
for facilitaMng the use of scores. - . 

For instructional purposes > the b^st type of test is one" that permits 
real diagnosis by reporting a profile of specific strengths and needs. The 
differences between diagnostic and other tests will be' explained, and the 
non-diagnosti.c 'nature of many familiar tests will be pointed- out. ' This • 
point- will be We by referenje^^ samples of forms for reporting indi- 
vidual pupils.' /test* scores.^/ Difrerences between ready-made and custom- • ' 
made tests will be d^^lea7-iHa~^e use of -the latter'will be explained.- 



^ Advice^^r interpreting each :,t^t will be .iased on' a jjumber of factors, 
incliidihg' the -numbers of itSms^er objective, specif ici'£^nd number of' ' 
objectives, and the data on the eest's (or its ^ectives,' ) -reliability. 
The output will be types of decision^ which, each test will suppor't. An 
important theme throughout will be the imperfect nature of test scores 
and the flexibility with which' tliey must be interpreted.. • ■ • 



Advice for facilitating the use of test scores, will refer to methods 
.for tdentifylng job-relevant or generic basic skills, the potential role 
of basic skills in writing Individual Education Plang^ resource persons 
who <!ould aid in making. instructional decisions, and how and when these ^ 
Vpers^ons could be most helpful. Alternatives for getting test results or 
; prescriptive information into the hands of vocational teachei^s will be' 
included as well. * . . i 



Teacher Guides - ' « . , ' ' \ 

Information in the Teacher Guides will, differ 'from that in the 
Resource Guide in that it. will deal with- diagnostic tests in general, 
rafher than specific tests, and will include some less formal diagnostic 
processes. The^^three luain topics will be decision making, clinical indica- 
tors of deficiencies, in basic skills, and informal diagnosis. Decisions 
about students* strengths an.d^needs can be made by comparing test scores, 
to a standard of proficiency, comparing scptes with the typical scores of 
local criterion groups (i.e.,, local students who ar& clearly proficient, 
marginal, and clearly needy) , or by using absolute and normative scores 
t^help" interpret each '"other,'' 

•V ' Clinical indicators ate behaviors by which a student reveals weaknesses 

. / ^ * . . . ^ 

'in basic skills. These include such clues, as avoiding" reading, doing 

ifeadipg assignments very slowly, consistently mispronouncing yords (nofc 

to be confused with havin^g a dialect) , • trying to get^ other students .to do 

' computations, and making errors in following, written or- oral directions'. 
Informal diagnosis would hot iijvolve the assessment of* skills so much as 

" the assessment of the student ♦ A methoH* of» last resort, it would, involve 
comparing a student *s*sc6res on standardized tests. with scores of local- 
criterion groups. Rather than pinpoint specif ic -stifengths- andi needs ±t I . 
would serve 1;p confirm the teacher* s Judgment about an individual's overall 

' need' tor remediation. - . • . ' - . 



^CHAPTER TWO ' 
ASSESSMENT INSTRUMENTS CTASK f ) 



i| Vocational students are required to use bas.ic ^kills with pro- 

|.ficiency..at^three early points in. their lives-^" " in .their vocational pro- 
.*! grams, in e|^try-le^l jobs, knd ^in, the role' of adults. ' This section • 
Veviews th|^e demands for proficiency and reports on 3. search for mateof- . 
1^?"^ Jr^°^^ thQ^ teaching and tesW»«r-W occupational basic skills, 
icon^t-pjations for the project's Gu^^s^ made throifihout. •' " • 



Basic Skill ' Recruirbments 



Demacids Made by Occupational Programs 



^Vocational students have to be able to read and jTommunycaVe iac^rfier 
tq succeed in their occupational prograins. Three acfulces of difficulty 
for students are technical vocabulary, text, Jl^. graphics. ' Materials to 

help vocational teachers with- each of these are discussed nfext.- 

I ' - ■ V ' . ' • ■ • 1 ■ . . 

• - . - . . ■ . K \- '. ■ ■^>> 

" ■ • ■' . i . 

Technical vodabalary. In entering any specialty jjne has?jrt:o* master 
the technical vocabulary, that is, %he. verba l-tbols of^the trade. " The si 
terms encode the basic concepts of a. specialty arid enable Jf fective., coi 
^munication about work As such "they cc^rise bbic occupational ^killl^^ ' 
which students must master to .;supc#ed .i^ any pfog^a|t. .^The i'niport^nce 




which vocational, teachers iaisijgi toT^pcabulary iff shown 



over 400 teachers in-eight different .occupational program areas in Floi 



by a survey of 



•(Redmtenri, 1979). • These^ respondents 'rated the important ■ 
teaching reading. -Out. x>f :the sixfcontefit " skiUs which e 



- ratings^ four relate to vpfeabular^r and tfie-'u^e of 'sources like, glossaries' 



ctioharies., 



of: 58 skills ii 
amed.^the hlghefis^ 



' \ ' g^^^ search Wa^ conducted for resources that identify 

Wl how}.to teach th^ui/'^On^ major work of^ ^ 



very high quality wasTfound: the V&^ffbnal -R^aSing Power- program. It • 
has both a module on how to teach v<fc2lbu4ary -li^',a''Contenjf''OT program* area 
and a set of key^word glossaries in s]^^feat?^>^^^^^ to V ' 

Welding. The glossaries give" multiple me'^ng^eif(>r4ttoi3j^ terms, guides to. 
pronouncing each term, and some illustra'tiW .diSgrCaa&.v§f So" that vocational 
teachers will nbt be limited to these- sets of^^'f^^^j^elmp^ule ^dn €each-.- 
ing vocabulary tells how to identify special ^^t^^n -a^^^^ 
^addition to this one comprehensive source, four^tkxi^S ^6^ ♦building voca-'^ 
tional vpcabulary are cited in Appendix, C. - ^^X^^"^'. .^' 

It is recommended that this project hot try^i^o .re-plicate €he efforts 
^f Vocational Reading Power (VFP) , but rather ii§e its materials^ as models 
and resources. In the present project's Guides methods^ for identifying, 
•^and teaching vocabulary should be described, following and 'explicifly 
crediting, VHP . Excerpts from the Vpp glossafies'^should'be/^iven both *or 1' 
d^Mustration and for directing, the vocational* teacher to the original 



sources.' 



Another type of vocabulary should be included -in the project's a, 

^Guides, that is, the basic terms of mathematics.' bften studeiits' difficul-^ 

' ' * * * . " . \ *.v . 

ties .in mathematics are verbal in origin, so vocational teachers should 

be made awdre of this problem and* given resources to deal with it' in the 

Teacher Guides. - • s. 



Text > Reading- comprehension is affected -by both the student*' s skill 

. and the difficulty of the 'text. Difficulty, of ten called readability, 

^ can- be measured iJ^ith .standard methods which were developed by authorities' 

like Fry, Flesch, aixd Chall. These methods show' that t^kt becomes .harden 
" * • .*-■'*'%* 

to read, iit general, as sentences get longer a^^Xjdr^s get tenger and 

less familiar. ^ By usiag any of these methods, oi||^')cVrt" compute, an index *of ' 

difficulty thaf is expressed lin grade-level tefmsw^ * , - " . \ . 

0 ^ . r ' ' • • ' . • • - ; S 

' • . t y 

'j^y^ * Voqational educators may find readability measures useful in several 
1^^' V- ' ^ays. First, feachers-. may. select texts at a level if ^ difficulty, that 'is 



^•m^-' ~ : . r 



»*- O J^'"^"* ' » - ' • '-i''^' 



J, 



I 



right for their students. Ne^ft," they may' plan the length and type of 
assignmfe^its. according to the difficulty, of the materials. Finally, they 
may adiy^t their teaching methods to accommodate the materials' difficulty 

, A search was conducted for pVactical sources on readability. Two 
types of sources were found: methods for analyzing the dif f iculty ,of 
text oneself, and existing analyses 'of "the reaSability of vocational texts 
Appendix D lists these sources. 



. In vocational education,- the Vocational leading Power project 
(Appendix -D) uses a compute'r program to analyze text. An operator types 
■the text at a computer terndhal, and* the program gives an analysis .in 
. . terms of several measures of reading difficulty. ' A somewhat different 
. - computer program for analyzing readability is available from authors at 
the Pensacola Junior College (Appendix D^. . 

'.NQt only are the computer,,programs avail'al^le, but three 'extensive 
analyses of yocatidnal texts have been conducted and reported. One, by- the 
^VRP staff, analyzes over 160 vocational texts which are popu^^-in MLnne-' 
sota. For. each text four readability indices are giveA and-'a mffasUre of 
the .variation in reading difficulty within each text is prpvfded. This 
. • report is ^lot yet available to the pub-lic. A -secohd analysis, done -by - ' 
the Blbomfield (CT) High School Reading Department , covers more than 200 
!• ' ' . ; VQcationaX texts that are used in Connecticut. For'.e^ac-h text it lists the 

index of usabi authors, publisher,' 

date of copyright, and- evaluative r.emarks. 'An earlier analysis of, 
-vocational texts,, done by the Cornell Institute *or Oocupational E'ducation, 
is also listed in Appendix D. " / 



^ ■ ,^pne peculiarity of vocational. reading matexial^eakens the, usefulness 

. ■ Of standard readability analyses"? the^'^technical vocabulary in vocational 
■1 , contains a, lot qf long words. ^ io^^ words inflate.readab*Mity meas- 

^ -ures^-Sth by. being, long ^nd by i,eing uncommon in general reading mtter. 
There, are ^however, two reasons why vocational terms probably do not ' 



5** 



Ml'.'., 



^increase! reading difficulty for vocational students as they .do for the 
general re'ade^. First, those terms are used commonly in vocational jon- ' 
texts, c Second, technical vocabulary should be a separate target of 
' vocational instruction. ^ When it is, that practice makes the reading ' V 

Tiiateriai less difficult for.thos'e students, irrespective, of its^'measured 
reading* level. ■ ^ ' 

This discussion supports sevei^al concrete recommendations for the 
project's Guides. One is that technical vocabulary be stressed in the 
Teacher's Guide as* a potential obstacle to reading,' and that methods for 
teaching technical terms should be stressed as leading to both fluency and. 
literacy in the vocations. Second, methods for doing readability analyses 
. should be given in the Resource' Guide, as should citations of computer 
programs for such analyses^. But an adjustment to the traditional methods 
should be provided. This adjustment will treat technical terms as short 
words in the instructional units following the unit where they are intro- 
duced. Finally, summaries of the published analyses of readability 
should' be reprinted in the Resource Guide for ready reference, along with 
suggestions for using such data. ' . * 

"^^^ . . Graphics . Much of the information in instructional materials for ^ 
^ ^ ^vocational classes is in the form of charts, diagrams, pictures, and other 
r- . graphics^ Students' understanding of their lessons can be ^s much affec- 
ted by the comprehensibi^lity of the graphics as it is by the readability . ^ 
of the text. Factors affecting the comprehensibility of grap>ics have 
vthe^ potential to inform the selection of materials,,, planiiing of asslgn- 
" ^ ment"©N^and modification- of teaching methods.^ - 

_ , ' Despite this line of re^oning, three factors support the recommen- 

dation to omit from the** project's Guides any treatment of the difficulty 
of graphics* First, vgcational teachers rate reading assignments in 
♦ graphics as being relatively unimportant. In the Florida study cited 

earlier, the six feaching skills related to graphics (e.*., pictures, ' * 
] sketches, figures^ diagrams, blueprints, maps, cartoons, graphs, charts, . . 

^schedules, • tables) ranked an average of 49th out of 58 in importance. 



Next, a search of articles on the construct visual • literacy shows that it- 
has- not yet developed a consensus or any strong instructional implications 
*(e.g., Wittich-and Schuller, 1973). 'Finally, the available sources do 
not specify teaching methods for overcoming/students' problems in under- 
standing graphics. 



Demands Made by Entry-Level J6bs 

The world, of work makes its own demand? on students to be proficient 
in the basic skills. The original intent of Task F/was to find tests of 
job-relevant b|sic skills which would permit judgments be made of entry- 
level competence. These tests were seen as measures of the success of 
remediation. The search- for 3uch tests referred to the following sourqes: 
catalogs of major test publishers; catalogs of text. publishers in the 
vocational field; A e ERIC search for Task E; research staff and bibliW ^ 
graphies of the Rfegional Curriculum Coordinating Centers JLn Vocational ' 
and Technical Education; lists of tests fr6m the Collection of "Edu^ia- 

tional Testing Service; and officials of National Qipation^ Competency 
■Testing institute and ^the, Chip instructional Materials Laboritory. 

' ' o 
One body of relevant testing materials was found: test items that 
are^uilt into b'asic ski;^ curriculum for the vocations. .Such items 
are called problem Sets, p^st-tests , achievement tests , or assessments, and 
are given at ends of uni^s, at ends 'of bpc{ks, in teachers' guides, or . 
completely separately.- These items were ..considered tests only when "the"' 
answers were not . given in the materials for ' students. Neither the relia- 
bility of these tests nor their level (entry or otherwise) is indicated - 
in the secondary sources t^at were consulted. These vocational curricula 
/ with bui;t-in, tests aTe listed in Appendix C. . 



•■. , The tekts. listed in Appendix C -^ll be included -iri the Res Our ce_ Guide 
to^elp -vocational -teachers select. .materials. " This listing, althbugh' 
tiseful, leaves many gaps. Another -approach is open, which involves a dif- 
ferent application, of r§soufces . i^ntified earlier for diagnostic 'testing. ' 



These ^sources are m^de-to-order conmerclal testa^nd item banks* 
AitKough the test items in these fesot^ces ar^ not phrased in occupa- 
tional terms i *they caa be selected to fit the exact basic skills of any- - 
occupation. . * , , ^ * a 

• The services of commercial test customizers are .quite" expensive, 
owing to ^the size of minimum orders, and hatve a l^^g-time of ^ix weeks or 
*more^ from receipt of orders* .In contrast tje tion-comnercial item banks 
are lower in cost atfd allow very quick preparation .btisite of tests 'to 
. order. . T . \* »• » * ' , ^ ♦ 

« «* 

One recommendation is for this projec-t ,to develop some prototypes 
of such tests and V^tfy tffeir ^acceptability an4> practicality with a - ^ - 
sample of vocational teachers.^,. Prot£>types may be developed from ite'm 
banks in the public domain/x^hich are on Jiaii^,^ such as the State of Cali^^ 
forriia Proficiency AssessmentrT^ample* fex^ Downer * s» prove' 

item, bank \ (ERIC #s ED 066 >494 through 06^ SCH) . Sample tests could Ije 
pilot.^tested in the -formative stages of the Guides' so as to inform the • 
decision "to emphasize or de-^emphasize* resources for customs-making tests. 

On finding that thes^fe job-targeted tests/oE basl^c skills "are iccept- 
al>l%. to teachers, the project should prepare^Xwo types -of supporting 
.inate*^^ is an indesclng which matches- entfy^level jobs with * 

tlieir unique sj^illffj The Ohio State taxonomy 

.reported /iS"^3;^sJcyE is a model for this matching, device/ Such an inJex 
will ^JJLqw teachers tovj^entify the job-relevant basic skills to teach" and 
\to teajt. Thus^^it will prpvide recipe§^ for custom-making, tests. 

^ * The^eacher's Guide should^ have a^ second aid to making up 'tests: a' 

section on Jiow to use Item banks and how to set standards*^ f or passing. . 

^ -^^ . <• ^ ' . - • / ^ 

Geni^ral advice on probleifis testing ' (e.g. , practice ^fects , guessing) 

'shoul,a%e;gi^n here too* ' . 

: ijemandis Madelby -Adult Li fe' * " ' ' 

■ ^ The need fot competencifes in basic sjcills to survive as an independent 
adult Is hard to deny. Yet*the fact 'that » suqh skills are lacking in many#„ 



-adults'has caused increasing public" conhfern and "increasihg'prp's sure on 
hi^ schopil- tp produce, graduates who have the minimal competencies. In 
response /.ff^arly. 40 states have adopted .programs, for testing minimal 
competencies and' 17 of' them have made "a passing score on such a test a- 
requirement' for graduation from- high school. These graduation tests. are 
taken here to be proxy .measures of proficiency in the basic "skills needed . 
for adul-t liffe. » ^ . . \ ' , " - 

- , " ■ ■' 

Testing to award high school diplomat, and Xhe. system of objectives, 
and tests-. leading up to that point, have.implications f or the vocational 
program. Vpcs'tional teachdrs can-e6ntribute to -students' attainment of the 

.competencies, and ^he students' ^employability may depend on bheir exhibiting. 

j^'&a.e. compgt^cies on the test. ^ 

It Is recommended that the Resource Guide include prescriptive steps 
.to make Vocational irfstruction .and testing for graduation' support' each % 
other. Blsed on an indexing of job-relevant basic skills, -this, section will 
, -direct a respurce person to identify the objectives that are, common to - '. 
the local graduation test dnd to each 'of the jobs, being learned. The 
resoxffce-^eijs-cn wiiL then give lists of these intersecting skills to- bfth 
; ^ vocational teacher and teachers who are the main source 



, of instruction in the^.ljasic.skills. 



support ,the['othets • .effort§. 



Each. can- wo.rk from these. lists to 



' • Summary >;o f Recommendations for the Reso.urce .and Teacher Guid es 

■ ■ ■. \-\ • . . ■ ■ . ■ . \ "1^ \ 

. . • A nuiter. recommendations for ^he Teacher ' s- and Resource Guides ' 
. are -^de .^n this .chapter. These deal, with technical, vocabulary, readability 

.;of.text,- testing of occupational basic" skills., and high school graduation 
. .ijequif^ents; Regarding technical ' terms, it. is.- recommended to use high^ • 
qualitfy^^^^^ sources - and. models - and not to duplicate previous 

;-.dev^iopment-^ff6rt^^ ^ Methods" for teaching te.chndcal terms^ including • 



.V>those..of fflat:h|^^ included' in "the Teacher.'s Guide 



X 



M-^S^&irV"/''^f-" for use in determining the reading level 




of texts: formulas (or computer programs) for doing original analyses of 
readability and results of analyses of vocational texts. An adjustment 
to'' traditional formulas is recommended in order to reflect tlje fact that 

a^ional terms are familiar in vocational settings. The Teacher's Guide 
shoultf^-^ye 'specif ic suggestions for using the. output of readability 
studies wh^ch take account of the strengths and limitations of these 
analyses. 

. / Two type^of testing materials are recommended:, tests embedded in 
texts of .occupational basic skills (e.g., Basic Engl ish for Business 
Communication ) and made-to-order tests • The former should bte listed in 
the Resource Guide, In developing resources on made-td-order tests It 
would be best to pilot test some prototypeVnstruments. A finding that 
^teachers need a^d w^nt such tests^ would justify our then writing directions 
for -the use of item banks for tl^e Teacher's Guide. ^ 
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Appendix -A /. 
NORM-REPERENSeD tests that were, screened- out *AFTE|l REVIEU 



y ■ 



Adult Basic Learning Examination by Psychological Corporation.. The ABLE 
^ .gives only five scores for the range of basic skills, hence* is not 
. ' diagnostic. The stores are for vocabulary ,.>spelling, reading, 
computation, and problem solving. 



Adult Basic Reading Inventory by Scholastic Testing Service. The techni- 
cal soundness of this test is not documented by the publisher. 

> i 

Adult Perfprmance Level Examination by the American College testing 

Program. The APL -gives only four scores in basic; skills (reading, 
writing, computation, and problem solving), so it is not diagnostic. 



.Ariaed Services Vocational Aptitude Battery by U.S. -Military Enlistment 

Processing Command. Only foujf of the twelve subtests relate 
\ [ directly^o basic academic skills. " ; . ' 



1 



Diagnbstit>^Math ,Tei5t by Fran St^enburgen Publications' does ^not offer^any 
'report of^eld testing for reliability!, v 



Diagnostic Reading' Scales by CTB McGraw-Hill. These ar^ diagnostic in . 
f^'Kt t^h^ area of phonics, but not in the. remainder of reading. Thus thfelr 
/ .scope is not appropriate here. vs 

Diagnostic Screening Tests.: Mathematics by Facilitation House. Field' 



\-tes.ttag^ not given, 



piagnbstic Tests in MaChei^ by Guidance Center. 
:r:eliability' data .aH^no reported ^ ' . 



Field testing and 
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Differential Aptitude Tests by Psychological Corporation. The DAT is not 
diagnostic of basic skills because mo st of the scores are for other 
variables while the scores for basic skills are given in ,very broad ' 
terms. " , / - 

Durrell Listening-Reading. Series by Psychological Corporation. In 

addition to having low reliability, the test is not clearly diagnostic. 

' * ... 

G^es-MacGinit^e Reading Tests by 'BobbsrMerrill, The 1978 edition ^es 
only two scores for the whole domain of reading. 

GED Tests of Reading, Mathematics, and Writing' Skills by Contemporary 
Books. The -niiinbers of items per objective in reading and mathema- 
tics are very low, and the test q|, writing skills is entirely 
.multiple choice. 

Iowa, Test .of Basic Skills by Houghton-Mifflin. The ITBS gives only two 

. . I . 

scoises each for reading and mathematics, so it is not diagnostic. 

. • ' 

McGraw-Hill Basic Skills System is^ for college-bound students, thus is 



not at' the appropriate level. 



Mechanics of Written English by Purdue University Research Center 
does not use a writing sample. f 

Sequent lair Tests of Educational Progress, by Educational TesMng ' Service. 
, ^ Although* this Hattery measures- reading, writing, listening, and 
mathematics, there are only one or- two "objec,tives" per area. 

USES (iineral. Aptitude. Battery by U.S. Emplojnnent Service. 6nly two of 
the nine scores deal with •'basic academic skills. 



, *Wide,.^Rangy|^Achievement Test by Jastak. This popular, t^st gives only 
. ' thre^^*scores f or a ^upil: spelling, reading, and arithmetic. 




It' 

Appendix ' ' . 
SAMPLE OF A FORMAT FOR REVIEWS OF TESTS ^ 



DIAGNOSTIC-MATHEMATICS • INVENTORY^ 
John K. Gessel 




Mi",' ■ - 



DESCIIIPTION 

A revision: of the earlier Prescriptive Mathematics Inventory, the DMI is-' 
.| seyen-leyel diagnostic te^-i^g system grades 1.5 through 7.5 plus". 
-•^The following 11 categories- of skills ar¥ covered: pre-operatiottal'Icon- 
^cepts, counting, matching, addition of single digits, addition of integers 
with more than 1 digit^ subtraction of H,ntegers, missing addends and fac- 
tors, sequences and -inequalities, measurement, -plane ' figures, and Inverse 
and place value. The DMI Has. from 37 to. -179 multiple choice items per 
level, with each item testing a' separate objective. The 'nuniber of choicer- 
per test item ranges from 5 to 10. For matm^lcills ^t- this broad level-^ 
of description— "measurement," "subtraction of>hQle^iiuqibers with regroup- 
ingi segments, lines-, rays"— the number, of skil]>p^ level varies from 
11 to 39 and the number of items per skill from 2 to 8^ 
. * • , ■ >v . . ■ ■ . ' 

To support classrood Instruction, the following optional materials are • 
available: interim tests for monitoring pupils' progress during t^year, 
learning, activities guide¥, guides Indexing the DMI to math teXt'serie 
-and, guides" to non-text 'teaching materials. 



PRICES'. 




^ Test;:bpofcs come^iti^;^ of 35 with an. Examiner's Manual. At the?^^^ 

^.^^ the reusable test books are 54<i-6l0 per puptl^ Machine Scored 

answ^r^^heets.are 13p-16<-- per pupil in seta of 50; hand scorable .ones^are 

s^^^^f 25. ^Consumable practice^ exercises ;forIlevelinsjupils . 
^fP|?^|8i^,^ the diagnostic tpsts are offered 'fpr Hi? per pupil fTsets ' 
-fJ^^^C^^^ serving all levels, is $3. 25.* Examinatioa 

^^^^^.^ '^^^ ^ all-level kit, pate of information: 




index whlqh keys ^ the test items and. 
the fpliowiiig text series: 
fef listed herie) 



As 



.SCORING ' . " • . 

Tests are m^hine scored at a cost of 70c to 97$ per pupil. The basic 
service includes all of the following: , responses , summaries by total . • 
scores of the group. For,^ additional cost of 15 C and 25$ pe'r ^pupil 
respectively, group and individual diagnostic reports are available. 
Estimated norms are opti«dtially available. Publisher says that the approxi 

mate time for returning scores to the us^r is 15 days from receipt. 

♦ ' m 

The' next page shows the form scorings will: .take. 

/■ . 

. *CTB McGraw-Hill, 1975 " < , 
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Appendix C 



" --V.-'f ■ . TEXTS " qN basic SKILLS IN VOCATIONS WHICH 

. --^f^-^r^'^r/^^^ TESTING MATERIALS BUILT IN 



HAVE 



• Agfetcuieugal Education' ' - . 

--Hasteri-ng Technical Terms; AGV Pow er/Anh^ 
. Merrill, 1976. ^ 



Indianapplis; Bobbs- 



V 



i^^^"^^"^'" - publication AG-73 .from' the'NeV'Jfersey 
. ; _ , , Vocational-Technical Curriculum CabAratory. ' • 

Distributive Education ••■ • 

Donzei'j., et al., Distributive Education;" Communicatio ns. 

Instructor's Curriculum . ED l7n A-^o . r~^- — ■ — ^ 

Logan, wTand Freeman, fl. Mathematics !& MarketlAg . New York- 
Gregg/McGraw-Hill, 1978: ' 

'» ^ . 

- ^^^'hiII;^!^^''^*'^""^ Mark,^finp. New York; ; Gregg/McGraw- 



..•flealthvEducatldh- 



- \ 



, : ■ H4xd4ni^^J.: :IJ; and'.Divis; H. -T. Mathematics for Health Ca reelrs . 
, . - • . Albany .oNew. York; De.lmaf,* 1980! ^ 



^S'^'^ . ^^'^^^'^f ^^^'^^^ N^ ^^ff- .Inciianapolis; ^obbs-Merrili.: 




Problems In Mathematics-rOff ice Woikers. 



'. and Handy , i£. s • - ^ B^siy English Por *^ 
Belmbiif. Calif orni^a-: PeatonrEitman, 




fliwkinson, B., Teacher Guide ->and Test Answers To Ten Office Education 
Mini-Manuals on Office Communication Proofreading , ED 146 320, 

Himstreet, W,, Porter, L, J., and Maxwell, G. wl Business English 
in Communications , Beimont, California, Fearo^rPitman, 1975. 

Martinka, Vocatidnal Mathematics For Business , Cincinnati: 

,South-Western, 1978, ' " ' 

Words At Work ; Clerlcall^Office, Norwalk, Connecticut! MIND, n,d, 
^Technical Occupations • /> 

* Mastering Technical Terms; Building Trades ,. Indianapolis; Bobbs-- 
Merrill, 1976, \ . 

Trades and Industrial ' , & 



V • Ball, J, Practical Problems in Mathematics-Masons , Albany, New 

^ York ; Delmar, 1980, I ^ ' 

Building Industrial 'Communications; ^Listening, Speaking, Writing , 
. Reading , Grade XII, ED 088 053, • 7^ 

. Cooper, G. S. and Hagisos, J. H, , eda. , Metrics' for [55 separate 
N ' .occupations], Columbus, OH: National Center For Vocational' 
and Technical* Education, 1977, ED 134 767, • 

D^Arcangelo, B,, D*Arcangelp, B,, and Guest, J, R, Matheipatlcs For 
Plumbers and Pipefitters , Albany,^ New -York; Delmar, 1973, 

Detuca, J. Practical Problems in\Mathematics-Print:ers , Albany, 
r r ' New York: Delmar, 1976, ' ; . 

, ^ - - , . » * 

Haines, R, G, Math Principles ^or Food Service dccup^tion8> ^^bany. 
New York; Pelmar,^ 1979, ' - 

Hale, G. S,, et al • Modem Mathematics as Applied To Machine Trades , 
^ _ ED 110 717. 

; - , Hendrlx, T. G, and LaFevor, C, S. Mathematics 'For Auto Mechanic sU 

^ * - / ^ ♦ Albany, New^York; Delmar^ 1978, \ ^ ..vf . 

It'^l " ' Heppa-, V. Math' for Masons , ED 164 816 

g^::>->t ' * * Hoffman, 'E, Practical Problems in MathematicsrMachlnists, Albany, 

; / ^.z..^New^^ork: ^. Delmar ^:'I980f^ - • - , . 

' ^ ^Hiith, H.* c; _ Practical Problems In Mathematics-Carpenters , Albany, 
, -New York: Delmar, .1979.";. • >-^^ . ... . 



^ ' ^ Industrial Communication Reading, SpeakinMlistening, Writing , 
. . ' f; Grade 3CII . ED 088 051. ♦ . • 



[ . Kubala, T. Practical Pr oblems in Matheinat:ics-Electrlgj ;.n«. Albany 

New York: Delmar, 1973. ' ~~ , ^ 

,- • • Larkin, J. Practical P roblems In Mathematlcs-Mechanjcal Drafting. 

Albany, New- York: Delmar, 1979; 

r ' . 

' Mastering Technical Term s; Welding . Indianapolis: Bobbs-Merrill 
• 1976. } ' 

■ Mathematics For Comiierc ial Foods . Publication FO-114 from- the New 
• ^ Jersey Vocational-Technical Curriculum Laboratory. 

. . Mathematics For Cosmetolp^ , Papts 1 and 2. Publication^- LC-21 and -22 

* ■ New Jeicsjy Vocational-Tecctet^al Curriculum Laboratory. 

• ' ^ mthematics f or Sheet Metal Fabrication . Albany, New York: Delmar, 

Moore, G. Practical Probl ems in Mathematics-Automotive T pc^n^ r-i .nc 
Albany, New York: Delmar, 1979^ ^ 

.- Schell F. and Matlock, B. pikcCical Problems in MathematiP.^-Wp -|Hpr« 
1^ ' Albany, New York: Delmar, 1975. ' ' ' • 

♦ "Schumacher, F '. Practical Problems in Mathematics-Sheet Metal Te4:hnie lans. 
Albany, New York: Delmar, 1973. ^ 

' • ■ » » 

Words At "Vork; Auto Mechanics. Norwalk, Connecticut: MIND, n.d. 
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^ CurricAli^ of St. Paul Technical Vocational Institute.. 

' Amthmetic For Careers . Albany, New York: DelTnar,^79. 



li^ - . . Fairbai 



t 



s, , and Schultheis; ' Mathematics Foif the Consumer. 



Cincinnati;: South-WeStem, 1980 

•Herr, N, K. Basic Mathematics Operations . ED 120 546. 

Herj, nL K;.- Decimals arid Percents; A Math P pacticp Booklet, 
ED/LZO 5.487^ ] '■ ' — ■ 



Heri:, M, K., ' Fractions .;and Their Applications ; 'a Math' Practice 
Mff-t -' • . Bjboklet . ED 120 549: : ^ — 



:instrttctional Ma terials-; Vocation-Related English . ^.065 665. 

feVi-^/i--'.— ^•'» -Sasserath, S-. , The Gonsumir ih the ' 

-'SiW:. ; — / Ma/ke tp'Iace';v^iBe Imdn t . California: * Fearon-Pi'tman,, 1976. 

W^^-'-- ■- >:^-'^^ttmann, C. Practical.PfoSlem s in Mathenjatjcs-Consumers . . Albany, 
• ' ■ York: Delmar r 1975t; ~ ~ ' 1 




Schell, F. R. Practical Problems In Mathematics-Metric System , 
Albany, New York: Delmar, 1980. 

Thompson, L. L. Consumer Mathematics . Enclno, California: 
Glencpe, 1977. 
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Weagraff,- p. J., and Lynn,. J. J. Communication At Work > New York: ^ 
Gregg/McGraw*Hill, 1980'. 



Ml''' 





6?^ 



ft;.- .-, 



^ . ' ' Appendix D ' v ' ' , ' - . 

READABILITY ANALYSES AND RESOURCES. FOR DOING' THEM • .-I*, •. ' 

V ' ■ . ; • • - 

Analyzing Printed Materials to Determine Ra;.d.hn;^^ Module Two of the 
Teacher Training Program for Vocational Teachers. " Tallahassee: 
UQdl"d ^i^^sity Vocational Reading and Math CBTE Prograp, 

Butz R. and GunaTmlan.'L. Vocational Reading Pover- Manual (Revised ) : 

Minneapolis:^^ The EXCHANGE, 1978. \ ; — \ ■ - », . 

Benaett, J.. G and Munerief M. C. . Instructional Materials" For Qccnn .l, - 
• . , Ed^^atl^rS's! ' '''''''' ;C°"^-ll-^-3tltute For Occupa?iotal 

^°"""no' T'nn^. Developr^nT^f-^Readabllltv An\Tv..f'.. pihal Report of Project 
f OEC-3-7.0705t-0326. Bureau of Res.eairch.. ' 

Office of Education, U.. S, Department of Healtl^, Edufcatioti, and' A 
Welfare. March 1969. . , a u j\x 

ReadabilltY Study. Minneapolis: Minnesota' Instructional Materials' ' ■ 
Center,. 1975. r " . ° . 

Walker', N. and BoilXot, Mw A/computeYize~dfreadlng le'veL analysis. 
• Educational Technolog y. .-1979^ - ^XlA^. - , ' 

Wolaaky D s. - An Analysis 'of Vocatl onal .I e ch nlcal Education Textbooks and 

• Materials Used Within ^the State of Conriectit^if . , 0^. . 

Bloomfield Public School, 1979. • ' ^^^i o'-^'i , * ' 
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